Pandas Profiling Report

Dataset statistics

Number of variables	12
Number of observations	683
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	64.2 KiB
Average record size in memory	96.2 B

Variable types

NUM	11
CAT	1

Reproduction

Analysis started	2020-07-03 14:08:18.336084
Analysis finished	2020-07-03 14:08:39.418573
Duration	21.08 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`UniformityOfCellShape` is highly correlated with `UniformityOfCellSize`	High correlation
`UniformityOfCellSize` is highly correlated with `UniformityOfCellShape`	High correlation
`df_index` has unique values	Unique

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct count	683
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	351.35578330893117
Minimum	0
Maximum	698
Zeros	1
Zeros (%)	0.1%
Memory size	5.3 KiB

Quantile statistics

Minimum	0
5-th percentile	35.1
Q1	176.5
median	355
Q3	526.5
95-th percentile	663.9
Maximum	698
Range	698
Interquartile range (IQR)	350

Descriptive statistics

Standard deviation	202.5639269
Coefficient of variation (CV)	0.5765208275
Kurtosis	-1.208617879
Mean	351.3557833
Median Absolute Deviation (MAD)	175
Skewness	-0.02098897312
Sum	239976
Variance	41032.14449

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
698	1	0.1%
230	1	0.1%
239	1	0.1%
238	1	0.1%
237	1	0.1%
236	1	0.1%
234	1	0.1%
233	1	0.1%
232	1	0.1%
231	1	0.1%
Other values (673)	673	98.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	0.1%
1	1	0.1%
2	1	0.1%
3	1	0.1%
4	1	0.1%

Value	Count	Frequency (%)
698	1	0.1%
697	1	0.1%
696	1	0.1%
695	1	0.1%
694	1	0.1%

ID
Real number (ℝ_≥0)

Distinct count	630
Unique (%)	92.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1076720.2269399706
Minimum	63375
Maximum	13454352
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	63375
5-th percentile	413929.8
Q1	877617
median	1171795
Q3	1238705
95-th percentile	1334001.2
Maximum	13454352
Range	13390977
Interquartile range (IQR)	361088

Descriptive statistics

Standard deviation	620644.0477
Coefficient of variation (CV)	0.576420905
Kurtosis	257.3684102
Mean	1076720.227
Median Absolute Deviation (MAD)	104296
Skewness	13.74841025
Sum	735399915
Variance	3.851990339e+11

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1182404	6	0.9%
1276091	5	0.7%
1198641	3	0.4%
704097	2	0.3%
1321942	2	0.3%
695091	2	0.3%
1017023	2	0.3%
385103	2	0.3%
1070935	2	0.3%
1240603	2	0.3%
Other values (620)	655	95.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
63375	1	0.1%
76389	1	0.1%
95719	1	0.1%
128059	1	0.1%
142932	1	0.1%

Value	Count	Frequency (%)
13454352	1	0.1%
8233704	1	0.1%
1371920	1	0.1%
1371026	1	0.1%
1369821	1	0.1%

ClumpThick
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.44216691068814
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	6
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.820761319
Coefficient of variation (CV)	0.6349966977
Kurtosis	-0.6331245309
Mean	4.442166911
Median Absolute Deviation (MAD)	2
Skewness	0.5876542361
Sum	3034
Variance	7.956694418

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	139	20.4%
5	128	18.7%
3	104	15.2%
4	79	11.6%
10	69	10.1%
2	50	7.3%
8	44	6.4%
6	33	4.8%
7	23	3.4%
9	14	2.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	139	20.4%
2	50	7.3%
3	104	15.2%
4	79	11.6%
5	128	18.7%

Value	Count	Frequency (%)
10	69	10.1%
9	14	2.0%
8	44	6.4%
7	23	3.4%
6	33	4.8%

UniformityOfCellSize
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.150805270863836
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	5
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.065144856
Coefficient of variation (CV)	0.9728131675
Kurtosis	0.0736791399
Mean	3.150805271
Median Absolute Deviation (MAD)	0
Skewness	1.226404096
Sum	2152
Variance	9.395112987

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	373	54.6%
10	67	9.8%
3	52	7.6%
2	45	6.6%
4	38	5.6%
5	30	4.4%
8	28	4.1%
6	25	3.7%
7	19	2.8%
9	6	0.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	373	54.6%
2	45	6.6%
3	52	7.6%
4	38	5.6%
5	30	4.4%

Value	Count	Frequency (%)
10	67	9.8%
9	6	0.9%
8	28	4.1%
7	19	2.8%
6	25	3.7%

UniformityOfCellShape
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.2152269399707176
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	5
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.988580818
Coefficient of variation (CV)	0.929508515
Kurtosis	-0.01681562061
Mean	3.21522694
Median Absolute Deviation (MAD)	0
Skewness	1.157890012
Sum	2196
Variance	8.931615308

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	346	50.7%
10	58	8.5%
2	58	8.5%
3	53	7.8%
4	43	6.3%
5	32	4.7%
7	30	4.4%
6	29	4.2%
8	27	4.0%
9	7	1.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	346	50.7%
2	58	8.5%
3	53	7.8%
4	43	6.3%
5	32	4.7%

Value	Count	Frequency (%)
10	58	8.5%
9	7	1.0%
8	27	4.0%
7	30	4.4%
6	29	4.2%

MarginalAdhesion
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.830161054172767
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.86456219
Coefficient of variation (CV)	1.012155187
Kurtosis	0.9424072094
Mean	2.830161054
Median Absolute Deviation (MAD)	0
Skewness	1.509181064
Sum	1933
Variance	8.205716543

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	393	57.5%
3	58	8.5%
2	58	8.5%
10	55	8.1%
4	33	4.8%
8	25	3.7%
5	23	3.4%
6	21	3.1%
7	13	1.9%
9	4	0.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	393	57.5%
2	58	8.5%
3	58	8.5%
4	33	4.8%
5	23	3.4%

Value	Count	Frequency (%)
10	55	8.1%
9	4	0.6%
8	25	3.7%
7	13	1.9%
6	21	3.1%

SingleEpithelialCellSize
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.234260614934114
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	2
Q3	4
95-th percentile	8
Maximum	10
Range	9
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	2.223085456
Coefficient of variation (CV)	0.6873550777
Kurtosis	2.129639279
Mean	3.234260615
Median Absolute Deviation (MAD)	0
Skewness	1.703716401
Sum	2209
Variance	4.942108947

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	376	55.1%
3	71	10.4%
4	48	7.0%
1	44	6.4%
6	40	5.9%
5	39	5.7%
10	31	4.5%
8	21	3.1%
7	11	1.6%
9	2	0.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	44	6.4%
2	376	55.1%
3	71	10.4%
4	48	7.0%
5	39	5.7%

Value	Count	Frequency (%)
10	31	4.5%
9	2	0.3%
8	21	3.1%
7	11	1.6%
6	40	5.9%

BareNuclei
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.5446559297218156
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	6
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	3.64385716
Coefficient of variation (CV)	1.027986138
Kurtosis	-0.7988441354
Mean	3.54465593
Median Absolute Deviation (MAD)	0
Skewness	0.9900156547
Sum	2421
Variance	13.27769501

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	402	58.9%
10	132	19.3%
5	30	4.4%
2	30	4.4%
3	28	4.1%
8	21	3.1%
4	19	2.8%
9	9	1.3%
7	8	1.2%
6	4	0.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	402	58.9%
2	30	4.4%
3	28	4.1%
4	19	2.8%
5	30	4.4%

Value	Count	Frequency (%)
10	132	19.3%
9	9	1.3%
8	21	3.1%
7	8	1.2%
6	4	0.6%

BlandChromatin
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.445095168374817
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	3
Q3	5
95-th percentile	8
Maximum	10
Range	9
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.449696573
Coefficient of variation (CV)	0.7110678959
Kurtosis	0.1676456428
Mean	3.445095168
Median Absolute Deviation (MAD)	1
Skewness	1.095270469
Sum	2353
Variance	6.001013297

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
3	161	23.6%
2	160	23.4%
1	150	22.0%
7	71	10.4%
4	39	5.7%
5	34	5.0%
8	28	4.1%
10	20	2.9%
9	11	1.6%
6	9	1.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	150	22.0%
2	160	23.4%
3	161	23.6%
4	39	5.7%
5	34	5.0%

Value	Count	Frequency (%)
10	20	2.9%
9	11	1.6%
8	28	4.1%
7	71	10.4%
6	9	1.3%

NormalNucleoli
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.869692532942899
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	3.052666407
Coefficient of variation (CV)	1.063760794
Kurtosis	0.4735882982
Mean	2.869692533
Median Absolute Deviation (MAD)	0
Skewness	1.420431124
Sum	1960
Variance	9.318772193

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	432	63.3%
10	60	8.8%
3	42	6.1%
2	36	5.3%
8	23	3.4%
6	22	3.2%
5	19	2.8%
4	18	2.6%
7	16	2.3%
9	15	2.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	432	63.3%
2	36	5.3%
3	42	6.1%
4	18	2.6%
5	19	2.8%

Value	Count	Frequency (%)
10	60	8.8%
9	15	2.2%
8	23	3.4%
7	16	2.3%
6	22	3.2%

Mitoses
Real number (ℝ_≥0)

Distinct count	9
Unique (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.603221083455344
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	1
95-th percentile	5
Maximum	10
Range	9
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	1.732674146
Coefficient of variation (CV)	1.080745609
Kurtosis	12.27337364
Mean	1.603221083
Median Absolute Deviation (MAD)	0
Skewness	3.511476241
Sum	1095
Variance	3.002159697

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	563	82.4%
2	35	5.1%
3	33	4.8%
10	14	2.0%
4	12	1.8%
7	9	1.3%
8	8	1.2%
5	6	0.9%
6	3	0.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	563	82.4%
2	35	5.1%
3	33	4.8%
4	12	1.8%
5	6	0.9%

Value	Count	Frequency (%)
10	14	2.0%
8	8	1.2%
7	9	1.3%
6	3	0.4%
5	6	0.9%

Class
Categorical

Distinct count	2
Unique (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	5.3 KiB

2	444
4	239

Common Values
Length

Value	Count	Frequency (%)
2	444	65.0%
4	239	35.0%

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	df_index	ID	ClumpThick	UniformityOfCellSize	UniformityOfCellShape	MarginalAdhesion	SingleEpithelialCellSize	BareNuclei	BlandChromatin	NormalNucleoli	Mitoses	Class
0	0	1000025	5	1	1	1	2	1	3	1	1	2
1	1	1002945	5	4	4	5	7	10	3	2	1	2
2	2	1015425	3	1	1	1	2	2	3	1	1	2
3	3	1016277	6	8	8	1	3	4	3	7	1	2
4	4	1017023	4	1	1	3	2	1	3	1	1	2
5	5	1017122	8	10	10	8	7	10	9	7	1	4
6	6	1018099	1	1	1	1	2	10	3	1	1	2
7	7	1018561	2	1	2	1	2	1	3	1	1	2
8	8	1033078	2	1	1	1	2	1	1	1	5	2
9	9	1033078	4	2	1	1	2	1	2	1	1	2

Last rows

	df_index	ID	ClumpThick	UniformityOfCellSize	UniformityOfCellShape	MarginalAdhesion	SingleEpithelialCellSize	BareNuclei	BlandChromatin	NormalNucleoli	Mitoses	Class
673	689	654546	1	1	1	1	2	1	1	1	8	2
674	690	654546	1	1	1	3	2	1	1	1	1	2
675	691	695091	5	10	10	5	4	5	4	4	1	4
676	692	714039	3	1	1	1	2	1	1	1	1	2
677	693	763235	3	1	1	1	2	1	2	1	2	2
678	694	776715	3	1	1	1	3	2	1	1	1	2
679	695	841769	2	1	1	1	2	1	1	1	1	2
680	696	888820	5	10	10	3	7	3	8	10	2	4
681	697	897471	4	8	6	4	3	4	10	6	1	4
682	698	897471	4	8	8	5	4	5	10	4	1	4

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows